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TOE  FLIGHT  SERVICE  STATION  TRAINING  PROGRAM:  1981  -  1985 


In  1978  a  new  Flight  Service  Station  (FSS)  Program  began.  At  that  time  new 
measures  and  norms  were  developed  to  create  standards  of  performance  which 
students  must  meet  to  become  eligible  for  acceptance  into  the  operational 
facility  work  force.  One  type  of  measure  was  the  FSS  Skills  Test,  a 
paper-and-pencil  simulation  of  laboratory  problems.  Skills  tests  were  developed 
in  three  areas:  Pilot  Briefing  (Preflight) ,  Inflight,  and  Bnergency  Services. 

In  addition  to  skills  tests,  primary  laboratory  exercises  were  developed  for 
these  same  areas.  Other  measures  included  in  the  program  were  secondary 
laboratory  exercises  in  the  areas  of  flight  data,  weather  observation,  teletype 
and  broadcast,  as  well  as  academic  block  tests  in  all  areas. 

A  final  grade  for  each  student  in  the  training  program  was  determined  in 
the  following  manner.  First,  a  composite  grade  for  each  student  was  formed  from 
a  linear  combination  of  the  skills  test,  primary  laboratory  exercises,  secondary 
laboratory  exercises,  and  academic  block  tests.  The  skills  tests  and  primary 
laboratory  exercises  were  assigned  the  highest  weights  in  the  linear 
combination,  80%  of  the  linear  combination  until  class  85007,  83.75%  from 
classes  85007  to  85016,  and  86%  since  class  85016.  Second,  a  phase  grade  for 
each  student  was  determined  from  a  transformation  of  the  composite  grade. 

Pickrel  (1979)  reported  on  the  development  of  the  passing  scores  for  the 
skills  tests  and  primary  laboratory  exercises,  and  on  the  development  of  the 
transformation  used  to  determine  the  phase  grade  from  the  composite  grade.  In 
general,  the  minimum  passing  scores  for  the  skills  tests  and  primary  laboratory 
exercises  were  selected  so  that  approximately  5%  of  the  examinees  from  a 
normative  group  of  eight  FSS  classes,  7801  to  9006,  failed  each  indicator.  The 
transformation  used  to  calculate  the  phase  grade  from  the  composite  grade  was 
determined  so  that  approximately  5%  of  the  students  would  receive  a  failing 
grade  below  70.  In  addition,  a  training  failure  also  occurred  if  any  student 
failed  both  the  skills  test  and  the  laboratory  exercise  in  one  of  the  primary 
areas.  Preflight,  Inflight,  or  Emergency  Services. 

This  report  describes  the  performance  of  the  ATC  specialists  who 
participated  in  the  FSS  training  program  from  1981  to  1985.  The  report  is 
limited  to  a  discussion  of  the  performance  of  the  students  on  the  skills  tests, 
the  primary  laboratory  exercises,  and  the  phase  grade.  1981  was  chosen  as  the 
starting  point  since  the  FSS  training  program  was  interrupted  for  a  short  time 
during  that  year  because  of  the  PATCO  strike.  Seme  modifications  to  the  skills 
tests  were  made  when  the  training  program  resumed,  and  other  modifications  have 
been  made  subsequently.  All  of  the  1981  classes  are  included  in  the  analysis 
for  completeness,  although  six  of  the  nine  classes  that  year  were  completed 
prior  to  the  strike. 

Method 


Appendix  A  lists  for  each  class  included  in  the  analysis  the  mean  scores 
for  each  skills  test,  each  primary  laboratory  exercise,  and  the  phase  grade. 
The  data  for  each  class  were  aggregated  by  year  and  the  following  statistics 
were  calculated. 
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First,  the  mean  and  standard  deviation  for  each  skills  test,  primary 
laboratory  exercise,  and  phase  grade  were  calculated  for  each  year.  In  the  case 
of  the  skills  tests,  means  were  also  computed  for  each  form  of  the  test  as 
appropriate. 

Second,  the  distribution  of  scores  was  determined  for  the  phase  grade,  the 
skills  tests,  and  the  laboratory  exercises.  Four  intervals  were  used  to  display 
the  data:  100-90,  89-80,  79  to  the  minimum  passing  score  (usually  70),  and 
failure  (usually  below  70).  For  the  skills  tests  and  laboratory  exercises,  each 
distribution  was  conpared  to  the  distribution  of  a  reference  group  of  FSS 
classes  which  consisted  of  the  normative  group  7801  to  9006  used  by  Pickrel 
(1979)  and  classes  9007  to  9012. 

Third,  the  correlations  of  each  measure  with  the  other  measures  were 
calculated  and  compared. 

Phase  Grade 


Table  1  contains  the  means,  standard  deviations,  distribution  of 
proportions  in  each  grade  interval,  and  correlations  for  the  phase  grade.  A 
slight,  but  steady,  increase  is  evident  in  the  average  grades  of  the  FSS  classes 
from  1981  to  1984.  During  these  years  increasingly  fewer  students  received 
grades  between  70  and  79.  The  percentage  of  students  with  grades  in  this 
interval  dropped  from  32.2%  in  1981  to  19.2%  in  1984.  During  these  same  four 
years  the  failure  rate  as  determined  by  the  phase  grade  varied  between  1.7%  and 
2.5%,  considerably  lower  than  the  approximately  5%  for  the  normative  classes. 

In  1985,  the  average  phase  grade  declined  noticeably  with  the  percentage  of 
students  with  grades  from  70  to  79  (25.2%)  and  the  percentage  of  failures  (6.2%) 
increasing  sharply. 

Even  though  the  skills  tests  and  the  primary  laboratory  exercises  have 
equal  weight  in  the  linear  combination  used  to  calculate  the  phase  grade, 
laboratory  scores  correlate  higher  with  the  phase  grade  than  do  the  skills 
tests.  The  correlations  of  the  phase  grade  with  the  laboratory  scores  range 
from  .721  to  .754  while  the  correlations  of  the  phase  grade  with  the  skills 
tests  range  from  .391  to  .564.  Interestingly,  the  phase  grade  correlates 
highest  with  the  Inflight  laboratory  score  and  lowest  with  the  Inflight  Skills 
Test. 


Skills  Tests 


Table  2  contains  the  summary  statistics  for  the  Preflight  Skills  Test.  Two 
forms  of  this  test  are  currently  in  use.  Form  C  was  introduced  in  1983. 


The  mean  scores  on  Form  B  have  increased  slightly,  but  steadily,  from  1981 
to  1985.  The  overall  change  of  1.43  is  approximately  1/4  of  a  standard 
deviation  which  is  considered  small.  Overall  Form  C  is  slightly  more  difficult 
than  Form  B,  but  the  difference  between  the  forms  is  not  significant.  The 
largest  difference,  which  occurs  in  1985,  is  1.25  points. 

Overall  the  performance  of  the  FSS  classes  from  1981  to  1985  is  better  than 
the  performance  of  the  reference  group,  7801  to  9012.  The  score  distributions 
for  the  1981  to  1985  classes  were  skewed  more  negatively  than  the  distribution 


for  the  reference  classes  with  the  1981-1985  classes  having  a  higher  proportion 
of  students  in  the  top  two  score  intervals  and  a  lower  proportion  in  the  lowe. 
two  score  intervals.  The  failure  rates  for  the  1981-1985  classes  ranged  from 
0.7%  to  2.7%,  far  lower  than  the  8.1%  for  the  reference  classes. 

The  Preflight  Skills  Test  correlates  about  the  same  with  the  other  skills 
tests  and  the  primary  laboratory  exercises.  The  overall  correlations  range  from 
.200  to  .268.  The  correlation  of  the  Preflight  Skills  Test  with  the  Preflight 
laboratory  score  (.254)  is  among  the  highest  of  the  correlations,  but  it  is  not 
as  high  as  the  correlation  wiith  the  Inflight  laboratory  score  (.268). 

Inflight 

Table  3  contains  the  suimary  statistics  for  the  Inflight  Skills  Test.  Four 
forms  of  the  test  are  currently  used.  A  revised  Form  D  was  introduced  late  in 
1981  after  the  PATCO  strike.  Form  E  was  introduced  in  1982,  and  Form  G  and  Form 
H  were  introduced  in  1983.  Most  of  the  classes  in  1985  took  either  Form  G  or 
Form  H. 

The  original  version  of  Form  D  had  a  maximum  of  73  possible  points.  The 
revised  version  of  Form  D  and  each  of  the  other  forms  have  a  maximum  of  125 
possible  points.  The  conversion  of  the  scores  from  a  0-73  metric  and  a  0-125 
metric  to  a  0-100  scoring  metric  has  resulted  in  a  different  transformation 
which  makes  the  original  Form  D  appear  harder  than  the  revised  Form  D  and  the 
other  forms.  The  performance  of  students  from  the  classes  in  which  the  original 
Form  D  was  given  and  those  from  classes  in  which  the  revised  Form  D  was  given  is 
shown  separately  in  Table  3  due  to  this  difference  in  apparent  difficulty. 

As  the  pattern  of  means  indicates,  marked  differences  in  the  relative 
difficulty  of  the  different  forms  are  apparent  which  are  not  due  to  different 
transformation  of  scoring  metrics.  Form  G  and  Form  H  are  the  easiest  forms. 

Form  E  is  more  difficult  than  these,  and  Form  D  is  the  most  difficult  of  the 
four  forms.  The  differences  between  Form  G  and  Form  H  and  the  other  forms  are 
large,  the  difference  being  almost  one  standard  deviation  relative  to  Form  E  and 
greater  than  one  and  a  half  standard  deviations  relative  to  Form  D. 

In  addition  to  differences  in  mean  performance  across  different  forms, 
differences  within  forms  across  time  are  evident.  The  mean  scores  on  the 
revised  Form  D  have  increased  steadily  since  1981.  A  steady  increase  in  mean 
performance  of  the  classes  on  Form  E  has  occurred  from  1982  to  1984.  However, 
these  increases  within  forms  are  not  as  large  as  the  differences  between  forms 
as  noted  above. 


The  distributions  of  scores  for  classes  from  1982  to  1985  on  the  Inflight 
Skills  Test  have  deviated  considerably  from  the  distribution  of  scores  for  the 
reference  classes.  These  deviations  are  due  to  at  least  three  factors.  First, 
the  change  in  possible  points  from  73  prior  to  the  end  of  1981  to  125  has 
resulted  in  a  score  transformation  advantage  of  about  8  points  on  the  average  to 
students  beginning  in  class  8129.  Furthermore,  due  to  the  nature  of  the 
transformation  examinees  who  score  lower  than  the  average  score  receive  more  of 
an  advantage,  while  examinees  who  scored  higher  than  the  average  score  receive 
less  of  an  advantage.  Second,  the  difference  in  the  difficulty  of  the  forms  has 
resulted  in  a  change  of  approximately  three  to  six  points  in  the  mean  score  for 
examinees,  with  examinees  taking  Form  G  and  Form  H  obtaining  the  higher  mean 
scores.  Note  that  in  1985  most  of  the  classes  (15  out  of  19)  took  the  easier 


forms  of  the  test.  Third/  the  within-form  increases  due  either  to  chance, 
better  instruction,  better  students,  or  compromises  in  the  security  of  the  test 
also  contribute  some  to  this  deviation. 


Since  1981  few  students  have  failed  the  Inflight  Skills  Test.  The  failure 
rate  for  the  reference  classes  was  6.1%  and  for  1981  the  failure  rate  was  14.3%. 
However,  since  1982  the  failure  rate  has  ranged  from  0  to  1.5%,  a  total  of  six 
failures  in  the  four  years. 

The  overall  correlations  of  the  Inflight  Skills  Test  with  the  other  skills 
tests  are  larger  than  the  correlations  with  the  laboratory  scores.  The  overall 
correlations  with  the  Preflight  Skills  Test  and  the  Emergency  Services  Skills 
Test  are  .231  and  .276,  respectively,  while  the  correlations  with  the  laboratory 
scores  range  from  .098  to  .200.  Except  for  1983,  the  correlations  of  the 
Inflight  Skills  Test  with  the  Inflight  laboratory  scores  were  good,  ranging  from 
.303  to  .432. 

Emergency  Services 

Table  4  contains  the  suntnary  statistics  for  the  Emergency  Services  Skills 
Test.  Three  forms  of  this  test  are  currently  used:  Form  C,  Form  D,  and  Form  E. 
Each  of  these  forms  was  introduced  in  1981  following  the  PATCO  strike.  The 
three  forms  generally  have  been  alternated  among  the  classes;  however,  in  1984 
and  1985  Form  E  was  administered  to  just  three  classes. 

The  mean  scores  on  each  form  have  increased  slightly,  but  steadily,  from 
1981  to  1985.  The  changes  in  the  mean  scores  for  Form  C  and  Form  D  have  been 
about  4/10  of  a  standard  deviation  overall,  which  is  moderate.  The  increase  in 
the  mean  scores  for  Form  E  has  been  somewhat  larger  than  the  increases  for  the 
other  two  forms;  however,  the  means  of  Form  E  for  1984  and  1985  are  based  on 
just  a  few  classes. 

In  addition  to  the  within-form  differences  just  noted,  some  slight  between 
form  differences  occur.  While  Form  E  is  somewhat  easier  than  Form  D  which  in 
turn  is  somewhat  easier  than  Form  C,  these  between-form  differences  are  very 
small. 


Overall  the  performance  of  the  students  from  1981  to  1985  on  the  Emergency 
Services  Skills  Test  is  better  than  the  performance  of  the  students  in  the 
reference  classes.  (Note  that  the  reference  classes  had  taken  an  earlier  form 
of  the  Emergency  Services  Skills  Test.)  In  the  classes  from  1981  to  1985  from 
51%  to  almost  70%  of  the  students  in  some  years  socred  at  least  90  on  this  test, 
while  only  44%  of  the  students  from  the  reference  classes  scored  at  least  90  on 
the  version  of  the  Emergency  Services  Skills  Test  which  they  took.  Fewer  than 
10%  of  the  students  from  1981  to  1985  scored  less  than  80,  while  25%  of  the 
students  from  the  references  classes  did.  In  addition,  the  failure  rate  of  0.5% 
(6  students)  from  1981  to  1985  is  1/10  of  the  failure  rate  (5%)  of  the  reference 
classes. 

The  overall  correlations  of  the  Emergency  Services  Skills  Test  with  the 
other  skills  tests  and  laboratory  scores  ranged  from  .254  to  .362.  These 
correlations  are  higher  than  the  corresponding  ones  for  the  Preflight  Skills 
Test  and  the  Inflight  Skills  Test.  Appropriately,  the  Emergency  Services  Skills 
Test  correlates  higher  with  the  Emergency  Services  laboratory  scores  (.362)  than 
with  any  other  skills  test  or  laboratory  score. 
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5. 

Primary  Laboratory  Exercises 

Pref light 

Table  5  contains  the  summary  statistics  for  the  Preflight  laboratory 
exercises  for  the  classes  from  1981  to  1985.  The  mean  performance  of  the 
students  changed  very  little  from  1981  to  1984;  however,  a  noticeable  decline 
in  performance  occurred  during  1985.  In  this  year  the  mean  score  decreased 
about  4/10  of  a  standard  deviation.  Also  during  1985,  9.3%  of  the  students 
failed  the  Preflight  laboratory  exercises.  While  this  percentage  is  about  the 
same  as  that  of  the  reference  group,  it  is  much  higher  than  the  0.8%  to  3.5% 
that  occurred  during  1981  to  1984.  Overall  the  students  from  the  1981-1985 
classes  have  performed  better  on  the  Preflight  laboratory  exercises  than  did  the 
students  from  the  reference  classes. 

The  Preflight  laboratory  scores  correlate  better  with  the  other  laboratory 
scores  than  with  the  skills  tests.  The  correlations  of  the  Preflight  laboratory 
scores  with  the  Inflight  laboratory  scores  and  the  Emergency  Services  laboratory 
scores  are  .525  and  .471,  respectively.  The  correlations  with  the  skills  tests 
range  from  .158  to  .271,  with  the  correlation  with  the  Preflight  Skills  Test 
(.254)  being  slightly  lower  than  the  correlation  with  the  Emergency  Services 
Skills  Test  (.271). 

Inflight 

Table  6  contains  the  summary  statistics  for  the  Inflight  laboratory 
exercises.  The  mean  performance  of  the  students  on  these  exercises  has  declined 
steadily  from  1981  to  1985.  This  decline  has  occurred  while  the  scores  on  the 
Inflight  Skills  Test  have  increased  steadily. 

In  sharp  contrast  to  each  of  the  other  laboratory  exercises  and  skills 
tests,  the  performance  of  the  students  in  these  classes  on  the  Inflight 
laboratory  exercises  has  not  been  as  good  as  the  performance  of  the  students 
from  the  reference  classes.  The  1981-1985  classes  have  a  lower  percentage  of 
students  scoring  at  least  90  on  the  Inflight  laboratory  exercises  and  a  higher 
percentage  of  failures  than  did  the  reference  classes.  In  fact  the  percentage 
of  failures  on  the  Inflight  laboratory  exercises  has  risen  dramatically  from 
7.9%  in  1981  to  23.1%  in  1985. 

In  a  similar  fashion  to  the  Preflight  laboratory  scores,  the  Inflight 
laboratory  scores  correlate  better  with  the  other  laboratory  scores  than  with 
the  skills  tests.  The  overall  correlations  with  the  Preflight  laboratory  scores 
and  the  Emergency  Services  laboratory  scores  are  .525  and  .523,  respectively, 
while  the  overall  correlations  with  the  skills  tests  range  from  .200  to  .287. 
Interestingly,  the  correlation  of  the  Inflight  laboratory  score  with  the 
Inflight  Skills  Test  is  the  lowest  of  these  overall  correlations. 

Emergency  Services 

Table  7  contains  the  summary  statistics  for  the  Emergency  Services 
laboratory  exercises.  In  a  similar  fashion  to  the  Preflight  laboratory 
exercises,  the  mean  performance  of  the  students  from  1981  to  1984  was  fairly 
stable,  but  declined  noticeably  in  1985.  While  the  students  from  all  these 
classes  have  generally  performed  better  than  the  students  from  the  reference 
classes,  the  failure  rate  has  increased  steadily  from  2.5%  in  1981  to  7.6%  in 


1984,  and  then  jumped  to  14.3%  in  1985 


As  was  the  case  with  the  Preflight  and  Inflight  laboratory  scores,  the 
Emergency  Services  laboratory  scores  correlate  better  with  the  other  laboratory 
scores  than  with  the  skills  tests.  The  correlations  of  the  Emergency  Services 
laboratory  scores  with  the  Preflight  laboratory  scores  and  the  Inflight 
laboratory  scores  are  .471  and  .523,  respectively,  while  the  correlations  with 
the  skills  tests  range  from  .098  to  .362. 


Summary 


1.  There  is  little  difference  in  the  performance  of  the  students  on  the 
different  forms  of  both  the  Preflight  Skills  Test  and  the  Emergency  Services 
Skills  Test;  however,  there  are  considerable  differences  in  performance 
among  the  forms  of  the  Inflight  Skills  Test  with  Form  G  and  Form  H  appearing 
to  be  much  easier  than  Form  D  and  Form  E. 

2.  The  performance  of  the  classes  on  the  skills  tests  has  increased  slightly 
from  year  to  year.  On  the  other  hand,  the  performance  of  the  classes  on  the 
Preflight  laboratory  exercises  and  the  Emergency  Services  laboratory 
exercises  has  been  fairly  stable,  except  for  a  noticeable  decline  on  both  in 
1985.  The  performance  of  the  classes  on  the  Inflight  laboratory  exercises 
has  declined  steadily  from  year  to  year. 

3.  The  students  from  the  1981  to  1985  FSS  classes  have  performed  better  as  a 
group  than  did  the  students  from  the  reference  classes,  7801-9012,  on  the 
skills  tests  and  laboratory  exercises,  except  for  the  Inflight  laboratory 
exercises  where  the  students  from  the  reference  classes  performed  better. 

4.  For  the  skills  tests,  the  classes  performed  best  on  Einergency  Services, 
followed  by  Inflight,  and  then  by  Preflight.  For  the  laboratory  exercises, 
the  order  is  Emergency  Services,  Preflight,  and  Inflight. 

5.  The  laboratory  exercises  correlate  better  among  themselves  than  do  the 
skills  tests  correlate  among  themselves.  In  addition,  the  laboratory 
exercises  correlate  better  with  the  phase  grade  than  do  the  skills  tests 
despite  having  the  same  weights  assigned  to  them  in  the  linear 
transformation  used  to  determine  the  composite  grade. 


Reference 


Pickrel,  E.  W.  (1979) .  Performance  Standards  for  Pass-Fail  Determinations  in 
the  National  Air  Traffic  Flight  Service  Station  Training  Program. 
(FAA-AM-79-18 } .  Washington:  D.C. :  Federal  Aviation  Administration. 
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Table  2 

Preflight  Skills  Test 
FSS  Classes  1981  to  1985 


Year 

Classes 

Examinees 

Mean 

S.D. 

Form 

JJ 

Form 

_C 

1981 

9 

122 

80.38 

5.54 

80.38 

a 

(9) 

1982 

18 

281 

80.46 

5.74 

80.46 

(18) 

1983 

18 

267 

80.81 

5.15 

80.87 

(9) 

80.75 

(9) 

1984 

19 

226 

81.34 

5.91 

81.45 

(10) 

81.32 

(9) 

1985 

19 

259 

81.13 

6.48 

81.81 

(ID 

80.56 

(8) 

The  number  in  parentheses  is  the  number  of  classes  taking  this  form. 


Proportion  of  Examinees  in  Each  Scoring  Interval 
Compared  to  Reference  Classes  7801-9012 


Year 

9,0-100 

80-89 

70-79 

Under  70 

1981 

.082 

.516 

.393 

.008 

1982 

.053 

.548 

.391 

.007 

1983 

.045 

.618 

.326 

.011 

1984 

.066 

.633 

.274 

.027 

1985 

.089 

.575 

.313 

.023 

7801-9012 

.041 

.441 

.437 

.081 

Correlations 

with  Skills 

Tests , 

Final 

Grade,  and 

Labs 

Year 

IFTEST 

ESTEST 

GRADE 

PFLAB 

IFLAB 

ESLAB 

1981 

.264 

.196 

.501 

.232 

.262 

.264 

1982 

.219 

.248 

.416 

.190 

.196 

.130 

1983 

.178 

.206 

.487 

.253 

.264 

.177 

1984 

.301 

.268 

.532 

.266 

.304 

.156 

1985 

.252 

.290 

.543 

.334 

.335 

.328 

All 

.231 

.254 

.492 

.254 

.268 

.200 

ft 


IS 


I 


E 


Kf 


tc 
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Table  3 

Inflight  Skills  Test 
FSS  Classes  1981  to  1985 


Year 

C la  s sc  s 

Exami  ncc  s 

Me  an 

S.D. 

T  orn. 

_D 

T  or;;. 

_E 

T  or  a. 

_C 

Torn. 

V. 

1981 

6 

86 

76.23 

8.42 

76.23 

(6)a 

,b 

1981 

3 

40 

84.82 

6.37 

84.82 

(3) 

1982 

18 

282 

87.40 

4.63 

86.15 

(10) 

88.85 

(8) 

1983 

18 

267 

89.70 

5.05 

86.47 

(6) 

89.91 

(6) 

93.96 

(3) 

92.08 

(3) 

1984 

19 

227 

91.44 

4.28 

87.82 

(M 

91.26 

(6) 

92.98 

(4) 

93.47 

(5) 

1985 

19 

260 

92.60 

4.15 

87.96 

(2) 

90.43 

(2) 

94.33 

(8) 

93.06 

(7) 

Classes  8101-8106  took  an  earlier  version  of  Form  D. 

The  number  in  parentheses  is  the  number  of  classes  taking  this  form. 


Proportion  of  Examinees  in  Each  Scoring  Interval 
Compared  to  Reference  Classes  7801-9012 


Year 

90-100 

80-89 

70-79 

Under  70 

1981 

.079 

.405 

.373 

.143 

1982 

.330 

.624 

.043 

.004 

1983 

.592 

.378 

.015 

.015 

1984 

.736 

.251 

.013 

.000 

1985 

.835 

.154 

.008 

.004 

7801-9012 

.081 

.538 

.319 

.061 

Correlations  with 

Skills  Tests, 

Final  Grade, 

and  Labs 

Year 

PFTEST 

ESTEST 

GRADE 

PFLAB 

IFLAB 

ESLAB 

1981 

.264 

.390 

.619 

.  258 

.387 

.082 

1982 

.219 

.439 

.610 

.498 

.432 

.376 

1983 

.178 

.236 

.373 

.196 

.091 

.053 

1984 

.301 

.205 

.416 

.141 

.303 

.176 

1985 

.252 

.  176 

.363 

.126 

.321 

.  193 

All 

.231 

.276 

.391 

.  158 

.  200 

.098 
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Table  4 


Emergency  Services  Skills  Test 
FSS  Classes  1981  to  1985 


Year 

Classes 

Examinees 

Mean 

S.D. 

Form 

C 

Form 

D 

Form 

E 

1981 

9a 

121 

88.82 

8.52 

88.50 

b 

(1) 

88.79 

(1) 

90.97 

(1) 

1982 

18 

279 

90.44 

6.84 

89.54 

(6) 

90.39 

(7) 

90.93 

(5) 

1983 

18 

265 

91.22 

6.63 

90.35 

(6) 

91.65 

(6) 

91.77 

(6) 

1984 

19 

224 

91.57 

5.70 

90.72 

(8) 

92.19 

(9) 

93.22 

(2) 

1985 

19 

258 

91.33 

6.25 

91.17 

(10) 

91.14 

(8) 

94.74 

(1) 

aSix 

classes  (8101' 

-8106)  took  an 

earlier  form  of 

Emergency  Services. 

bThe 

number  in  parentheses 

is  the 

number  of 

classes  taking  this 

form. 

Proportion  of  Examinees  in  Each  Scoring  Interval 


Compared  to  Reference  Classes  7801-9012 


Year 

90-100 

80-89 

70-79 

Under  70 

1981 

.512 

.388 

.083 

.017 

1982 

.581 

.355 

.057 

.007 

1983 

.675 

.242 

.072 

.011 

1984 

.696 

.250 

.054 

.000 

1985 

.651 

.275 

.074 

.000 

7801-9012 

.440 

.310 

.200 

.050 

Correlations  with 

Skills  Tests, 

Final  Grade 

,  and  Labs 

Year 

PFTEST 

IFTEST 

GRADE 

PFLAB 

1FLAB 

ESLAB 

1981 

.196 

.390 

.569 

.213 

.262 

.190 

1982 

.248 

.439 

.525 

.277 

.299 

.382 

1983 

.206 

.236 

.581 

.238 

.205 

.322 

1984 

.268 

.205 

.524 

.229 

.287 

.274 

1985 

.290 

.176 

.636 

.368 

.394 

.501 

All 

.254 

.276 

.564 

.271 

.287 

.362 

t  •’  £  +  *  mi 


Table  5 

Preflight  Laboratory  Exercises 
FSS  Classes  1981  to  1985 


Year 

Classes 

Examinees  Mean  S.D. 

1981 

9 

122 

86.11  6.20 

1982 

18 

281 

86.01  7.98 

1983 

18 

267 

86.98  6.20 

1984 

19 

226 

85.61  7.69 

1985 

19 

259 

82.47  9.78 

Proportion  of  Examinees  in 

Each  Scoring  Internal 

Compared  to  Reference  Classes  7801-9012 

Year 

90-100 

80-89 

70-79  Under  70 

1981 

.320 

.516 

.156  .008 

1982 

.327 

.502 

.142  .028 

1983 

.337 

.528 

.127  .007 

1984 

.319 

.496 

.150  .035 

1985 

.239 

.421 

.247  .093 

7801-9012 

.040 

.495 

.374  .091 

Correlations  with  Skills 

i  Tests, 

Final  Grade,  and  Labs 

Year 

PFTEST  IFTEST 

ESTEST 

GRADE  IFLAB  ESLAB 

1981 

.232  .258 

.213 

.652  .559  .291 

1982 

.190  .498 

.277 

.746  .635  .418 

1983 

.253  .196 

.238 

.677  .399  .312 

1984 

.266  .141 

.229 

.732  .494  .453 

1985 

.334  .126 

.368 

.774  .507  .539 

All 

.254  .158 

.271 

.734  .525  .471 
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Table  6 

Inflight  Laboratory  Exercises 
FSS  Classes  1981  to  1985 


Year 

Classes 

Examinees 

Mean 

S.D. 

1981 

9 

126 

82.46 

7.67 

1982 

18 

282 

82.06 

9.18 

1983 

18 

268 

80.35 

8.07 

1984 

19 

227 

79.59 

9.44 

1985 

19 

258 

78.21 

11.50 

Proportion  of  Examinees  in  Each  Scoring  Interval 

Compared  to  Reference  Classes  7801-9012 

Year 

90-100 

80-89 

72-79  Under  72 

1981 

.159 

.516 

.246 

.079 

1982 

.149 

.546 

.209 

.096 

1983 

.101 

.478 

.280 

.142 

1984 

.119 

.436 

.264 

.181 

1985 

.092 

.419 

.258 

.231 

7801-9012 

.193 

.553 

.203 

.051 

Correlations  with  Skills  Tests, 

Final  Grade,  and 

Labs 

Year 

PFTEST  IFTEST 

ESTEST 

GRADE  PFLAB 

ESLAB 

1981 

.262  .387 

.262 

.709  .559 

.341 

1982 

.195  .432 

.299 

.803  .635 

.493 

1983 

.264  .091 

.205 

.701  .399 

.414 

1984 

. 304  . 303 

.287 

.779  .494 

.482 

1985 

.335  .321 

.394 

.752  .507 

.593 

All 

.268  .200 

.287 

.754  .525 

.523 

2*3ICV 
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Table  7 

Emergency  Services  Laboratory  Exercises 
FSS  Classes  1981  to  1985 


Year 

Classes  Examinees 

i  Mean 

S.D. 

1981 

9 

121 

90.78 

6.59 

1982 

18 

279 

91.16 

8.87 

1983 

18 

265 

89.33 

8.53 

1984 

19 

224 

89.58 

8.33 

1985 

19 

258 

85.42 

12.65 

Proportion  of  Examinees  in 

Each  Scoring 

Interval 

Compared  to  Reference  Classes  7801- 

9012 

Year 

90-100 

80-89 

76-79 

Under  76 

1981 

.636 

.273 

.066 

.025 

1982 

.703 

.215 

.043 

.039 

19  83 

.592 

.283 

.053 

.072 

1984 

.576 

.317 

.031 

.076 

1985 

.426 

.337 

.093 

.143 

7801-9012  .315 

.470 

.070 

.145 

Correlations  with  Skills 

Tests , 

Final  Grade, 

and 

Labs 

Year 

PFTEST  IFTEST 

ESTEST 

GRADE  PFLAB 

IFLAB 

1981 

.264  .082 

.190 

.518  .291 

.341 

1982 

.130  .376 

.382 

.670  .418 

.493 

1983 

.177  .053 

.322 

.661  .312 

.414 

1984 

.156  .176 

.274 

.703  .453 

.482 

1985 

.328  .193 

.501 

.825  .539 

.593 

All 

.200  .098 

.362 

.721  .471 

.523 

a 


,v 
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Appendix  A 


Skills  Tests,  Laboratory  Scores,  and  Phase  Grades 
for  FSS  Classes  from  1981  to  1985 


PFTEST 


11 

79.08  B 

80.88  B 

79.38  B 

83.38  B 

78. 46  B 

82.86  B 

82.14  B 
80.94  B 

78.88  6 

80.33  B 

78.80  B 

79.50  B 

81.89  B 

79.35  B 

82.47  B 

78.93  B 

82.78  B 
79.07  B 

82.14  B 

78.86  B 
79.45  B 
81.69  B 

80.56  B 

81.63  B 

80.25  B 

80.56  B 

81.29  B 
81.44  C 

79.33  B 

78.89  C 

80.56  C 

81.20  B 

82.55  B 

82.13  C 
80.62  C 
83.43  B 
81.00  C 

79.60  B 

82.25  C 

80.93  B 

80.71  B 
80.88  C 

78.83  B 

79.20  C 


IFTEST 


4.07 

74.14 

73.25 
75.24 

83.15 

78.85 

85.29  D 

84.21  D 

85.11  D 

85.19  D 

88.56  E 

90.13  E 

82.67  D 

86.56  D 

85.71  D 
86.76  D 

86.80  E 

85.11  D 
87.31  E 

90.14  E 

88.21  D 
85.73  D 
89.23  E 

88.17  D 

S8.50  E 
87.44  D 

90.11  E 

88.35  E 

86.56  D 

85.17  D 

89.61  E 

88.72  D 

91.87  E 

84.36  D 

89.40  E 

93.85  G 
92.71  H 

90.33  E 
92.10  H 

86.56  D 

93.40  G 
91.43  H 

94.63  G 

87.41  D 

89.87  E 


ESTEST 


7.27 

81.21 

89.71 

88.38 

92.98 

90.55 

88.50  C 

88.79  D 
90.97  E 

89.16  C 

88.33  D 

94.55  E 

85.79  E 
90.02  D 

87.55  C 

88.53  D 

90.26  E 

90.30  C 

87.73  D 

94.17  D 
88.65  C 

90.89  C 

90.68  C 

93.12  E 

93.34  E 

90.83  D 
93.08  D 

90.73  D 

91.54  E 
90.46  E 

90.63  C 
91.96  E 
91.05  C 

91.81  E 
94.25  D 

90.61  C 
87.60  D 

90.89  C 

92.68  E 
92.09  D 
92.20  E 
89.08  C 

92.86  D 

92.35  D 

89.83  C 


3 

8 

00 

7 

15. 


CUSS 


IFTEST 


ESTEST 


PFUB 


IFUB 


ESLAB 


GRADE 


82.60 

C 

94.10 

G 

93. 

,76 

C 

80.91 

B 

88.64 

D 

93. 

,63 

D 

82.50 

B 

89.92 

E 

92. 

,57 

C 

84.73 

C 

92.45 

H 

93. 

26 

D 

80.89 

C 

91.11 

D 

95. 

,10 

C 

76. 10 

E 

91.80 

E 

90. 

,79 

D 

80.89 

C 

91.70 

G 

93. 

,47 

E 

83.25 

B 

93.63 

H 

87. 

,16 

C 

77.53 

C 

86.93 

D 

89. 

,88 

D 

80.38 

B 

90.75 

E 

89, 

,37 

C 

81.83 

B 

93.33 

G 

91. 

,70 

D 

82.80 

B 

90.10 

E 

87, 

,85 

C 

81.33 

C 

94.25 

H 

91. 

,76 

D 

84.55 

B 

94.18 

E 

94. 

,65 

D 

81.45 

C 

92.91 

H 

90, 

,54 

C 

79.67 

C 

84.58 

D 

92. 

,98 

E 

80.67 

B 

90.83 

E 

91. 

,86 

D 

82.78 

C 

92.78 

G 

89. 

,43 

C 

81.53 

B 

94.12 

H 

92. 

,18 

D 

79.06 

C 

88.25 

D 

94. 

,74 

E 

84.75 

B 

92.56 

E 

92. 

.45 

C 

79.86 

B 

94.64 

G 

89. 

,60 

D 

80.07 

C 

93.86 

H 

92. 

,71 

C 

77.33 

B 

88.31 

E 

89. 

,49 

C 

82.67 

C 

87.67 

D 

91. 

,37 

D 

82.14 

C 

92.14 

G 

90. 

.15 

D 

80.23 

B 

93.15 

H 

90. 

,14 

C 

79.43 

C 

92.50 

H 

90. 

,44 

D 

82.89 

B 

95.33 

G 

92. 

,24 

C 

75.00 

C 

93.56 

G 

90, 

,66 

D 

78.67 

B 

92.42 

H 

84, 

,18 

C 

81.83 

B 

95.33 

G 

92. 

,83 

C 

84.55 

B 

95.82 

G 

93, 

,27 

D 

85.50 

B 

93.50 

H 

96, 

,20 

C 

83.86 

B 

93.57 

G 

88, 

,94 

D 

84.50 

C 

92.25 

H 

90. 

,63 

C 

80.43 

B 

94.29 

G 

94, 

,66 

D 

81.63 

C 

93.75 

H 

90, 

,77 

C 

